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? Abstract 






p^ A unified approach to studying convergence and stochastic stabiUty of continuous time consensus 

protocols (CPs) is presented in this work. Our method appUes to networks with directed information 
pr"' flow; both cooperative and noncooperative interactions; networks under weak stochastic forcing; and 

^-^ those whose topology and strength of connections may vary in time. The graph theoretic interpretation 

Q_^ of the analytical results is emphasized. We show how the spectral properties, such as algebraic con- 

(— I nectivity and total effective resistance, as well as the geometric properties, such the dimension and the 

structure of the cycle subspace of the underlying graph, shape stability of the corresponding CPs. In 
addition, we explore certain implications of the spectral graph theory to CP design. In particular, we 
point out that expanders, sparse highly connected graphs, generate CPs whose performance remains uni- 
formly high when the size of the network grows unboundedly. Similarly, we highlight the benefits of 
C^ using random versus regular network topologies for CP design. We illustrate these observations with 

*^ numerical examples and refer to the relevant graph-theoretic results. 
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1 Introduction 



The theory of CPs is a framework for design and analysis of distributed algorithms for coordination of 
C^ the groups of dynamic agents. In many control problems, agents in the group need to agree upon certain 

quantity, whose interpretation depends on the problem at hand. The theory of CPs studies the convergence 
to a common value (consensus) in its general and, therefore, abstract form. It has been a subject of intense 
research due to diverse applications in applied science and engineering. The latter include coordination 
of groups of unmanned vehicles f42}. IST] ; synchronization of power, sensor and communication networks 
|[T0l[T2]l : and principles underlying collective behavior in social networks |36| and biological systems Il4ll45]|. 
to name a few. 

From the mathematical point of view, analysis of continuous time CPs is a stability problem for systems 
of linear differential equations possibly with additional features such as stochastic perturbations or time 
delays. There are many effective techniques for studying stability of linear systems ifTTlfTSll . The challenge 
of applying these methods to the analysis of CPs is twofold. First, one is interested in characterizing stability 
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under a minimal number of practically relevant assumptions on the structure of the matrix of coefficients, 
which may depend on time. Second, it is important to identify the relation between the structure of the graph 
of interactions in the network to the dynamical performance of CPs. A successful solution of the second 
problem requires a compilation of dynamical systems and graph theoretic techniques. This naturally leads 
to spectral methods, which play important roles in both mathematical disciplines, and are especially useful 
for problems on the interface between dynamics and the graph theory [ 15|. A general idea for using spectral 
methods for analyzing CPs is that, on the one hand, stability of the continuous time CP is encoded in the 
eigenvalues (EVs) of the matrix of coefficients; on the other hand, EVs of the same matrix capture structural 
properties of the graph of the CP. The spectral graph theory offers many fine results relating the structural 
properties of graphs to the EVs of the adjacency matrix and the graph Laplacian |[T4l [H [H |9l [191 [211 l50l . 
This provides a link between the network topology and the dynamical properties of CPs. 

In this paper, under fairly general assumptions on CPs, we study two problems: convergence of CPs and 
their stability in the presence of stochastic perturbations. The former is the problem of asymptotic stability 
of the consensus subspace, a one-dimensional invariant (center) subspace. The latter is a special albeit 
representative form of stability of the consensus subspace with respect to constantly acting perturbations 
f26.l . The rate of convergence to the consensus subspace sets the timescale of the consensus formation 
(or synchronization) from arbitrary initial conditions or upon instantaneous perturbation. Therefore, the 
convergence rate is important in applications where the timing of the system's responses matters (e.g., in 
decision making algorithms, neuronal networks, etc). Stochastic stability, on the other hand, characterizes 
robustness of the consensus to noise. This form of stability is important when the consensus needs to 
be maintained in noisy environment over large periods of time (e.g., communication networks, control 
of unmanned vehicles, etc). We believe that our quantitative description of these two forms of stability 
elucidates two important aspects of the performance of CPs. 

The questions investigated in this paper have been studied before under various hypotheses on CPs: 
constant weights ||38l[32lll2l, time-dependent interactions |[34lllll[lll, and CPs with time-delays ll24l[38l . 
Optimization problems arising in the context of CP design were studied in P6ll48ll49l . There is a body of 
related work on discrete time CPs B8ll37ll . Robustness of CPs to noise was studied in Il5ni23ll . In this paper, 
we offer a unified approach to studying convergence and stochastic stability of CPs. Our method applies 
to networks with directed information flow; both cooperative and noncooperative interactions; networks 
under weak stochastic forcing; and those whose topology and strength of connections may vary in time. 
We derive sufficient conditions guaranteeing convergence of time-dependent CPs and present estimates 
characterizing their stochastic stability. For CPs on undirected graphs, we show that the rate of convergence 
and stability to random perturbations are captured by the generalized algebraic connectivity and the total 
effective resistance of the underlying graphs. Previously, these results were available only for CPs on graphs 
with positive weights |[34ll5T1l . To further elucidate the role that network topology plays in shaping the 
dynamical properties of CPs, we further develop our results for CPs on simple networks (see text for the 
definition of a simple network). Our analysis of simple networks reveals the role of the geometric properties 
of the cycle subspace associated with the graph of the network (such as the first Betti number of the graph; 
the length and the mutual position of the independent cycles) to the stability of CPs to random perturbations. 
In addition, we explore several implications of the results of the spectral graph theory to CP design. First, 
we show that expanders, sparse highly connected graphs |[T9ll43ll . generate CPs with the rate of convergence 
bounded from zero uniformly when the size of the network tends to infinity. In particular, CPs based 
on expanders are effective for coordinating large networks. Second, we point out that CPs with random 
connections have nearly optimal convergence rate. In contrast, the convergence of CPs on regular lattice- 
like graphs slows down rapidly as the size of the network grows. We illustrate these observations with 



numerical examples and refer to the relevant graph-theoretic results. 

The mathematical analysis of CPs in this paper uses the method, which we recently developed for study- 
ing synchronization in systems of coupled nonlinear oscillators |[30ll29l and reliability of neuronal networks 
f3r|. We further develop this method in several ways. First, we relate the key properties of the algebraic 
transformation of the coupling operator used in |[30l l29l l3T1l for studying synchronization to general prop- 
erties of a certain class of pseudo- similarity transformations. Second, we strengthen the graph theoretic 
interpretation of the stability analysis. We believe that our method will be useful for design and analysis of 
CPs and for studying synchronization in a large class of models. 

The outline of the paper is as follows. In Section |2j we study the properties of a pseudo-similarity 
transformation, which is used in the analysis of CPs in the remainder of the paper. Section|3]is devoted to the 
convergence analysis of CPs. After formulating the problem and introducing necessary terminology in |3.1[ 
we study convergence of CPs with constant and time-dependent coefficients in §3.2| and ^33] respectively. 
Section |4]presents estimates characterizing stochastic stability of stationary and time-dependent CPs. These 
results are applied to study CPs protocols on undirected weighted graph in Section [5] In Section [6} we 
discuss the relation between the connectivity of the graph and dynamical performance of CPs. The results 
of this paper are summarized in Section|7] 

2 Pseudo-similarity transformation 

The analysis of CPs in the sections that follow relies on certain properties of a pseudo-similarity transfor- 
mation, which we study first. 

Definition 2.1. Matrix D € M.i^-p)>^i^-p) {1 < p < n - 1) is pseudo-similar to D e M'^'^" via S G 

SD = DS. (2.1) 



Equation (2.1 1 is equivalent to the following property 

Sq{D) = q{D)S, (2.2) 

for any polynomial q{t). 

To study the existence and the properties of pseudo-similar matrices, we recall the definition of the 
Moore-Penrose pseudo-inverse of a rectangular matrix (cf. |[T6l ). 

Definition 2.2. A+ g M"^^'" is called a pseudo-inverse of A (^ MT'"'' if 

AA+A = A and A+ AA+ = A+ . 

Throughout this section, we use the following assumption. 
Assumption 2.3. Let D G M"^" and S G m!^'^-p)^^'^ (1 < p < n - 1) such that 

rank S = n — p, (2.3) 

kerS C kerZ?. (2.4) 



Condition (|2.3|) implies that 



S+ = S^{SS'^)-\ (2.5) 



and SS+ = L 



n—p- 



(2.6) 



and, therefore, 

S S = -Pr(s'T) = P(kei. 5)± , 

Here, Pms''') ^^^ In-p denote the projection matrix onto the column space of S'^ and the {n — p) x [n — p) 
identity matrix. 



The combination of ( 2.3 1 and ( 2.4 1 guarantees the existence and uniqueness of the pseudo-similar matrix 
for D via S. 



Lemma 2.4. Let S G ]R("-p)^" and D G R"^" satisfy Assumption 

b = SDS+ 
is a unique pseudo-similar matrix to D via S. 



2.3 



Then 



(2.7) 



Proof. By the first identity in (2.6 1, 



DS+S = D. 



Therefore, equation (2.1 1 is solvable with respect to D. By multiplying both sides of (2.1 1 by 5^ from the 



right and using the second property in (2.6 1, we obtain ( |2.7| ) 

D 



Corollary 2.5. 



exp{tD} = 5exp{tD}5+, iG 



(2.8) 



Proof. Equation (2.8 1 follows from the second identity in (2.6 1 and the series representation of exp{iL)}. 



D 



The next lemma relates the spectral properties of D and D. 



Lemma 2.6. Suppose D and S satisfy Assumption 2.3 and D is the pseudo-similar matrix to D via S. 



A If X G C is a nonzero EV of D then A is an EV of D of the same algebraic and geometric multiplicity. 
Moreover, S carries out a bijectionfrom the generalized X—eigenspace ofD onto that of D preserving 
the Jordan block structure. 

B X = is an EV ofD if and only if the algebraic multiplicity ofO as an EV ofD exceeds p. In this case, the 
algebraic multiplicity ofO as as an EV of D is diminished by p. S maps the generalized 0—eigenspace 
ofD onto that ofD. 

C S maps a Jordan basis ofD onto that of D. 

Proof. 

A S restricted to the direct sum of generalized eigenspaces of D corresponding to nonzero eigenvalues is 
injective. 

Let A be a nonzero EV of D. Since for any m G N, (l) - XIn^p)"'S = S{D - Xln)"^ (cf. Ej\), Sv 



is a generalized A— eigenvector of D of index m if and only if f is a generalized A— eigenvector of D 
of index m. Therefore, S bijectively maps the generalized A— eigenspace of D onto that of D. The 
associated Jordan block structures are the same. 



B If the generalized 0— eigenspace of D is larger than ker S then ker D is nontrivial. Choose a Jordan basis 
for D restricted to its generalized 0— eigenspace 



,(1) .,(1) 



-'1 



,(1) 



, v\' ,... vl\' , (ker D"" ker D 



m— 1^ 



Dv[^\Dv^2^\ . . . Dvl}\v^^\v^2\ ■ ■ ■ ^k\ (ker Z?™-^ ker L>™-2) 



D^ 



(m-i)„(i) nC'"-!),/^) 



^<^z) 



^2 ' 



L> 



^fci ' • • • ' ^1 ' ^2 ' ■ • • ^fc„ 



(kerL»). 



The image of this basis under S consists of the vectors forming a Jordan basis of D restricted to its 
generalized 0— eigenspace and p zero vectors. Under the action of S, each cyclic subspace of D 

span (vf\Dvf,...D"'-'vf 

— ■ (i) 

looses a unit in dimension if and only if Z?™ ^v- G ker S. 

C The statement in C follows by applying the argument in B to a Jordan basis of D restricted to the 
generalized eigenspace corresponding to a nonzero eigenvalue. 

D 

Next, we apply Lemmas [2.4| and [2!6| to the situation, which will be used in the analysis of CPs below. 

Corollary 2.7. Denote e = (1, 1, . . . , 1)"^ G R" and 1 = span {e}. Let D G ]R("-i)x" and S e ]R("-i)x" 
be such that 

D e)C = {M € M"''" : Me = 0} and ker 5* = 1. (2.9) 



By Lemmas 2.4 and 2.6 we have 



3! Z) G M("-1)^("-i) : SD = bS 

2. 

D = SDS+. 

3. Denote the EVs of D counting multiplicity by 

Ai = 0, A2, A3, ... , A„, 
such that e is an eigenvector corresponding to \i. Then 

A2, A3, . . . , A„ 



(2.10) 
(2.11) 

(2.12) 

(2.13) 



are the EVs of D. For i = 2,3, . . . ,n, S maps bijectively the generalized \i— eigenspace s of D to 
those of D. is an EVofD if and only if the algebraic multiplicity ofO as an EVofD is greater than 
1. 



Example 2.8. The following matrix satisfies {2.9) and can be used as an intertwining matrix in (2.10) 



S 



/ -1 1 
-1 1 

V 



\ 


-1 1 / 



t,{n—l)xn 



(2.14) 



3 Convergence analysis of CPs 



In ^ 3. 1 we introduce a continuous time CP, a differential equation model that will be studied in the remainder 



of this paper. Convergence of CPs with constant and time-dependent coefficients is analyzed in ^3.2 and 
p.3[ respectively. 



3.1 The formulation of the problem 



By a continuous time CP with constant coefficients we call the following system of ordinary differential 
equations (ODEs): 

rii) = 



XV- = ^aij(j;(-')-x(^)), i£[n]:={l,2,...,n}. (3.1) 



Unknown functions x^^\t),i G [n] are interpreted as the states of n agents. The right hand side of (3.1 1 
models the information exchange between agents in the network. Coefficient aij is interpreted as the weight 
that Agent i attributes to the information from Agent j. Positive weights promote synchronization between 
the states of the corresponding agents. Negative weights have the opposite effect and can be used to model 



noncooperative interactions between the agents. For more background and motivation for considering (3.1 1 
and related models we refer an interested reader to |[34l[36ll38ll42ll5Ti . 

An important problem in the analysis of CPs is identifying conditions, under which the states of the 
agents in the network converge to the same value. 



Definition 3.1. We say that CP (3.11 reaches a consensus from initial state x{0) G M" if 



lim Ix'-^^t) - x'-'^t)] = V(i,j) e [nf. (3.2) 



t— >oo 



IfCP {3.1) reaches a consensus from any initial condition then it is called convergent. 



The second problem, considered in this paper, is that of stability of the consensus subspace 1 to instanta- 
neous and constantly acting random perturbations. An important aspect of the analysis of convergence and 
stability of CPs is elucidating the relation between the structural properties of the network (e.g., connectivity 
and weight distribution) and the degree of stability of the corresponding CPs. To study this problem, we 



need the following graph-theoretic interpretation of (3.1 1 



Let A = (aij) G M"^" be a matrix of coefficients of (3.1 1. Since (3.1 1 is independent from the choice of 



diagonal elements of A, we set an = 0,i €^ [n]. Using the terminology from the electrical networks theory 



||T|, we call A a conductance matrix. Next, we associate with (3.1 1 a directed graph G = {V, E), where the 
vertex set V = [n] lists all agents and a directed edge (i, j) G [n]^ belongs to E if Ojj ^ 0. 

By the network we call J\f = {V,E,a) = {G,a), where function a : E ^ R assigns conductance 
aij G R to each edge {i,j) G E. If conductance matrix A is symmetric, G can be viewed as an undirected 
graph. If, in addition, aij G {0, 1}, AA is called simple. 

3.2 Stationary CPs 

The convergence analysis of CPs with constant and time-dependent coefficients relies on standard results 
of the theory of differential equations (see, e.g., [ 18 1). It is included for completeness and to introduce the 
method that will be used later for studying stochastic stabihty of CPs. 



We rewrite (13. lb in matrix form 



X = Dx. 



(3.3) 



The matrix of coefficients 



N 



(3.4) 



D = A- diag{ai,a2,...,aN), Qi = y^ a-ij 

j=i 

is called a coupling matrix. 

Let S € m("^^)^" be a matrix with one dimensional null space, ker 5 = 1 (see Example 
possible choice of S). The analysis in this section does not depend on the choice of S. Suppose S has been 
fixed and define 

S={SS'^)-^S. (3.5) 



2.8 



for a 



Note that S has orthogonal rows 



SS'^ = In-i and S'^ S = S~^S = Pj^±, 



(3.6) 



where P]^± stands for the orthogonal projection onto 1^. By definition, D and 5 satisfy conditions of 
Corollary |2.7| Therefore, there exists a unique 5— reduced matrix 



D = SDS+ = {SS'^y'^SDS'^iSS'^)-^ = SDS'^, 



(3.7) 



whose properties are listed in Corollary 2.7 In addition, using normalized matrix S (cf. (3.5 1) affords the 
following property. 



Lemma 3.2. Let D £ IC and S be as defined in {3.5\. Then D, the pseudo-similar matrix to D via S, is 
normal (symmetric) if D is normal (symmetric). 



Proof. If D is symmetric, then so is D by (3.7 1 



Suppose D is normal. Then there exists an orthogonal matrix V = (e, f2, fa, • • • , Vn) and diagonal 
matrix 



A = diag 0,A2,...,Afc,,( ,,...,, 

\Pfci+l Ofci+l / \Pki 0!ki 



such that D = VAV'^. By Lemma|2^ D = Uku'^ . with U = {Sv2, Svs, ..., Svn) and 
A = diag I A2, 



aki -Pki 



^^' vAi+1 "fci+i y ' ■ ■ ■ ' \f3ki oiki 

Denote the columns of U by Uj, i G [ri]/{l}. Since 

ujui = vJS'^Svi = VjPi±Vi = vjvi, i,j e {2, 3, . . . , n}, 

U is an orthogonal matrix. Therefore, D is normal. 

D 



By multiplying both sides of (3.3 1 by S and using (2.1 1, we obtain the reduced equation for y = Sx £ 
/?"-! : 

y = by. (3.8) 



Under S, the consensus subspace of (3.3 1 is mapped to the origin of the phase space of the reduced system. 
Furthermore, because D inherits its spectrum from D (cf. Lemma 2.6 1, there is a direct relation between 
the transverse stability of the consensus subspace 1, as an invariant center subspace of the original problem 



( 3. 1 1, and that of the equilibrium at the origin of the reduced system ( 3.8 1. This relation is described in the 



following theorem. 



Theorem 3.3. CP (3.3) is convergent if and only if 

D & D := {M G IC &: M is a stable matrix}, 



(3.9) 



where M is the pseudo-similar matrix to M via S (cf. {3.5\). If D G T>, the rate of convergence to the 
consensus subspace is set by the nonzero EV of D with the largest real part. Specifically, let the EVs of D 



be arranged as in Corollary 2. 7 and 



a 



max Re Aj . 

i>2 



Then there exists Ci > such that for any initial condition x(0) G R" and any e > 

\Pi^x{t)\ < Ci|Pi±x(0)| exp{(-a + e)t}, 
where \ ■ \ stands for the Euclidean norm in i?"~^. 



(3.10) 



(3.11) 



Proof. Let x{t) be a solution of (3.3 1. Denote the projection of x{t) onto 1 by 

z{t) = Pixx(t) = S^Sx{t). 



By multiplying both parts of (3.3 1 by S^ S and using (3.6 1, we derive an ode for z{t) 

z = S^bSz. 



(3.12) 



On the other hand, 



y{t) = Sx{t) = SS'^Sx{t) = Sz{t) 



satisfies the reduced equation y = by. Therefore, S : M" — ;■ M"~^ ^ l-^ provides a one-to-one correspon- 
dence between the trajectories of the reduced system and the projections of the trajectories of ( 3.3 1 onto the 
orthogonal complement of the consensus subspace, 1^. In addition, S maps the consensus subspace to the 
origin of phase space of the reduced system. Therefore, transverse asymptotic stability of 1 as an invariant 



linear subspace of ( 3.3 1 is equivalent to the asymptotic stability of the fixed point at the origin of the reduced 
system. The necessary and sufficient condition for the latter is that l) is a stable matrix, i.e., D G V. 

If D G D then Ai = is a simple eigenvalue and the real parts of the remaining EVs are negative. By 
standard results of the theory of ODEs, there exists a positive constant Ci such that for any initial condition 
y(0) = Sx{0) G M"^^ and any e > 0, the solution of the reduced system satisfies 



|y(t)|<Ci|y(0)|exp{(-a + e)t}. 



(3.13) 



Therefore, 

D 



|Pixx(i) = \S^y{t)\ = \y{t)\ < Ci|y(0)| exp{(-a + e)t}. 
For CPs with nonnegative weights aij > there is a simple sufficient condition of convergence: non- 



negative CP (3.3 1 is convergent if the corresponding digraph is strongly connected II38I . This condition does 



not hold in general if there are negative weights. Edges with positive weights help synchronization. In con- 
trast, negative weight a-ij < indicates that Agent i does not cooperate with Agent j in reaching consensus. 
The lack of cooperation by some agents in the network can be compensated by the cooperative interactions 
between other agents. The consensus can be reached even if many of the weights are negative, as shown in 
the following example. 

Example 3.4. The following example of a random matrix D £ D was constructed in I130\I : 



D 



( -1.0251 2.2043 

-0.1264 0.2772 

-1.1549 2.5819 

-0.8807 1.9231 

V -0.9049 1.8778 



-1.6032 0.5044 -0.0804 \ 

-0.3006 0.2060 -0.0562 

-1.9613 0.5210 0.0133 

-1.0823 0.0333 0.0066 

-1.0060 0.3772 -0.3441 / 



(3.14) 



About half of the entries ofD are negative, i.e., there are as many noncooperative interactions as cooperative 
ones. Nonetheless, the resultant CP is convergent. 



3.3 Time-dependent CPs 

In realistic networks, the strength and even topology of connections between the agents may depend on 
time. To account for a greater variety of possible modeling situations, in this section, we use only very 
mild assumptions on the regularity of conductances aij{t) as functions of time: aij{t), {i,j) G [n]^, are 
measurable locally bounded real-valued functions. Under these assumptions, we formulate two general 
sufficient conditions for convergence of time-dependent CPs. 
By a time-dependent CP, we call the following ODE 



x = D{t)x, D{t) = {dij{t)) £ 
where the coupling matrix D{t) is defined as before 



(3.15) 



D{t) = A(t)-diag(ai(t),a2(t),...,a„(t)), ai{t) = ^ay(t). 



(3.16) 



Under our assumptions on aij{t), the solutions of (3.15 1 (interpreted as solutions of the corresponding 
integral equation) are well-defined (cf. fTFl). 



By construction, coupling matrix D satisfies the following condition (see (3.4i) 

D{t) G /C Vt > 0. 
For convenience, we reserve a special notation for the class of admissible matrices of coefficients: 

D{t) G /Ci := {M{t) G M"^" : mij{t) G L'^M'^) & (Af (t) G /C Vt > 0)}. (3.17) 



2.3 



SD{t)S+, 
Below, we present two classes of convergent time-dependent CPs. The 



Note that for any t > there exists a unique pseudo-similar matrix to D{t) via S, D{t) 
provided S satisfies Assumption 



first class is motivated by the convergence analysis of CPs with constant coefficients. 



Definition 3.5, / I30I/ Matrix valued function D{t) G /Ci is called uniformly dissipative with parameter a if 
there exists a > such that 



y^b{t)y < -ay^y Vy € M""^ & Vi > 0, 



(3.18) 



where D{t) is the pseudo-similar matrix to D[t) via S. The class of uniformly dissipative matrices is 
denoted by Pq,. 

The convergence of uniformly dissipative CPs is given in the following theorem. 



Theorem 3.6. Let D{t) G T>a, a > 0. CP (3.15) is convergent with the rate of convergence at least a. 



Proof It is sufficient to show that y(t) = is an asymptotically stable solution of the reduced system 
for y = Sx 

y = b{t). 



For solution y{t) of the reduced system, we have 



d 
dt 



Thus, 

n 



y\^ = 2y'^bit)y<2a\y\\ 



\y{t)\<\y{0)\exp{at}. 



In conclusion, we prove convergence for a more general class of CPs. 
Definition 3.7. The coupling matrix D{t) is called asymptotically dissipative if 



D £V = {M{t) G /Ci : limsupt"^ / sup y'^M{u)ydu < 0}. 



Tlieorem 3.8. If D{t) £ V then CP (3.15) is convergent. 



Proof. Let y{t) be a solution of the reduced system (3.19 1. Then 



4|y|2 = 2y'^b{t)y < 2jit)\y\^, j{t) := sup y'^b{t)y. 



dt 



|y|=i 



By Gronwall's inequality. 



Since D{t) G V, 



Thus, 



D 



\yit)\ <|y(0)|exp{/ -f{u)du}. 
Jo 

3a>0kT>0 : {t > T) ^ [ -f{u)du < 

Jo 

\yit)\ < |y(0)| exp{-at} < -at, t > T. 



-at. 



(3.19) 



(3.20) 
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4 Stochastic stability 

In this section, we study stochastic stability of CPs. Specifically, we consider 

D{t)x + aU{t)w, x{t) gM", 



X 



L 



loc\ 



(4.1) 
The consensus subspace, 1, forms an invariant center subspace of the deterministic system ob- 



where ti; is a white noise process in M."-, D{t) G /Ci (cf. (3.17 1), and U{t) = {uij{t)) E 



tained from (4.1 ) by setting cr = 0. 



Since the transverse stability of the consensus subspace is equivalent to the stability of the equilibrium of 
the corresponding reduced equation, along with (|4.1|), we consider the corresponding equation for y = Sx: 



y = D{t)y + aSU{t)w, 



(4.2) 



where S is defined in ( 3.5 1. The solution of ( 4.2 ) with deterministic initial condition y (0) = yo G 



on— 1 



IS a 



Gaussian random process. The mean vector and the covariance matrix functions of stochastic process y{t) 



m{t) := Ey{t) and V{t) := E {y{t) - m{t)){y{t) - m{t)y 
satisfy linear equations (cf. 1211 ) 

m = Dm and V = DV + V D^ + a"^ SU {t)U {tY S'^ . 



(4.3) 



(4.4) 



The trivial solution y{t) = of the reduced equation (3.8 1 is not a solution of the perturbed equation (4.2 1. 
Nonetheless, if the origin is an asymptotically stable equilibrium of the deterministic reduced equation 



obtained from (4.2 1 by setting o" = 0, the trajectories of (4.1 1 exhibit stable behavior. In particular, if (3.15 1 



is a convergent CP, for small cr > 0, the trajectories of the perturbed system (4.1 1 remain in 0{(t) vicinity 



of the consensus subspace on finite time intervals of time with high probability. We use the following form 
of stability to describe this situation formally. 



Definition 4.1. CP (3.151 is stable to random perturbations (cf. {4.1)) if for any initial condition j;(0) G 
and T > 



lim EPixx(t) = and E|Pixx(t)p 



0(^2), tG[0,T]. 



(4.5) 



Theorem 4.2. Let D € Pq, be a uniformly dissipative matrix with parameter a (cf. Definition 3.5). Then 



CP {3.15) is stable to random perturbations. In particular, the solution of the initial value problem for {4.1 ) 



with deterministic initial condition x(0) G M" satisfies the following estimate 



E|Pi_L2;(t)|2 < 



~2a 



sup \\U{u)U'^{u)\\, t>0, 



(4.6) 



MG[0,t] 



where \\ ■ \\ stands for the operator matrix norm induced by the Euclidean norm. 



Remark 4.3. Suppose the strength of interactions between the agents in the network can be controlled by an 
additional parameter g 

X = gD{t)x + aU{t)w. (4.7) 

Here, the larger values oi g > correspond to stronger coupling, i.e., to faster information exchange in the 
network. By applying estimate (|4.6[) to (|4.7|), we have 



E\Pj_±x{t)\^ < 



a'^n 



'^90i Me[o,i] 



sup \\U{u)U'^{u)\\, t>0. 



(4.8) 
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Note that the variance of |P]^±x(t)| can be effectively controlled by g. In particular, the accuracy of the 
consensus can be enhanced to any desired degree by increasing the rate of information exchange between 
the agents in the network. For the applications of this observations to neuronal networks, we refer the reader 
to||3ll[321. 



Remark 4.4. Since P-^^x{t) = S'^y{t) and (Pi±x(t))"''Pi±x(t) = y{tyy{t), it sufficient to prove (4.6 1 



with P-^±x{t) replaced by the solution of the reduced problem (4.2 1, y{t) = Sx{t) 



Proof. Let ^{t) denote the principal matrix solution of the homogeneous equation (4.2 1 with cr = 



The solution of the initial value problem for (4.2 1 is a Gaussian random process whose expected value and 
covariance matrix are given by 



Eyt 



^(t)yo, 



COY 



yt = a^<^{t) [ <i>-\u)SU{u)U{u)'^S'^i^-\u))'^du'^it)'^. 
Jo 

Since D{t) G Dq,, we have 

y''D{t)y < -ay'^y Vy G W'-\ t > 0. 



(4.9) 
(4.10) 

(4.11) 



This has the following implication. For all t > 0, —D'^{t) is positive definite and, therefore, (— Z)*(t))~2" 
is well defined. Here and throughout this paper, M'^ := 2^^(M + M^) stands for the symmetric part of 
square matrix M. 

Using this observation, we rewrite the integrand in (4.10l as followsjj 



< 



<^-Hu){-D'{u))H-D'iu))^SU{u)Uiu)'^S'^i-D'{u))^{-D'{u))^{<l>~\u))'^ 

-\\Fiu)mu)-'D^{u)mu)-'y = l\\F{u)\\-^{Hur\Hu)-'y} 



(4.12) 



where 



F{u) := {-D'{u))^SU{u)U^{u)S^{-D'{u))^. 
By taking into account ( 4.12| ), from ( |4.10 ) we have 



Further \ 



2 2 

Trcovyi < ^ sup {\\F{u)\\}Tv {I - ^t)'^^t)} < ^ sup \\F{u) 
^ u6[o,t] ^ Me[o,t] 



\F{u)\\ = \\{-b\u))=^S\J(u)\j\u)S\-B\u)\ 

< \\U{u)U^{u)\\\\SS^\\\\i-D%u))-^ 

< a-'\\Uiu)U^iu)\\, 



(4.13) 



(4.14) 



since ||S'5"'"|| = 1 (cf. ([3^). Estimate ^^ follows from ^^, ( |4.13| ), and ( |4.14| 

n 



Theorem 4.2 describes a class of stochastically stable time-dependent CPs. Because much of the previ- 
ous work focused on CPs with constant coefficients, we study them separately. To this end, we consider 



X = Dx + aw, 



(4.15) 



holds for any nonnegative definite matrix B £ 



The derivations of the estimates 1 4.12 1 and 1 4.14 1 use the following matrix inequality: A{B — \\B\\I„)A^ < 0, which obviously 



and any A G 
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and the corresponding reduced system for y = Sx 

y = Dy + aSw. 



(4.16) 



In (4.15 1, we set U{t) = In to simplify notation. 



Theorem 4.5. Suppose that D £ V and a has the same meaning as in {3.10). Then for any < e < a, 
there exists a positive constant C2 such that 



2 ^ C2(T^n 



lim EPixx(t) = and E|Pi±x(t)|^ < 



Proof. Since D ^ V, for any e G (0, a), there exists a cha nge of coordinates in 



, X 



\ such that De = Qj^DQ, e D^-e (cf. [3]). By Theorem 4.2 

X = DeX + aQ~ w 



(4.17) 



solutions of 



satisfy (4.6 1. Thus, (4.17 1 holds with for some C2 > possibly depending on e. 
D 

The estimate of E|P]^±x(t)p in (4.17 1 characterizes the dispersion of the trajectories of the stochastically 



forced CP (4.151 around the consensus subspace. E|P]^±x(t)p can be viewed as a measure of stochastic 
stability of consensus subspace. In (4.17i, the upper bound for E|P]^±x(t)p is given in terms of the leading 



nonzero eigenvalue of D. If D is normal then precise asymptotic values for cov Sx{t) and E|P]^xx(t) | are 



available. The stability analysis of (4.15) with normal D is important for understanding the properties of 
CPs on undirected graphs, which we study in the next section. 

Theorem 4.6. Suppose D & T> is normal. Denote the E Vs of D by Xi, X2, ■ ■ ■ \n, where Ai = is a simple 
EV. Let D be a pseudo-similar matrix to D via S (cf. {3.5 \). Then for any deterministic initial condition 



x{Qi) G M", the trajectory of {4.15) is a Gaussian random process with the following asymptotic properties 

0, (4.18) 

(4.19) 



lim |EPix2;(t)| 



lim cov Sx{t) 

t— >oo 



lim E|Pi_La;(t)|^ 



2-^a^b-\ 



2-1(72 ^(ReAi)-\ 



(4.20) 



j=2 



Proof By the observation in Remark 4.4 it sufficient to prove the relations (4. 18 1 and (4.20 1 with 
Pi±x(t) replaced by y{t) = Sx{t). 



The solution of the reduced equation (4.16 1 with a deterministic initial condition is a Gaussian process 

(cf. lED) 






From (|4.4|) specialized to solutions of (4.16 1, we have 



Ey(t) 
Vit) = cov y{t) 



e*^yo 



0,as t — 7- 00, 



a 



2 / e^t-u)DggT^it-u)D^^^_ 



(4.21) 

(4.22) 
(4.23) 
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Since SS'^ = In-i and Z) is a stable normal matrix, from (4.23 1 we have 

'■t . _2 



Vit) 



e^''^'du^—{b')-\ t^oo, 



(4.24) 



where D^ = 2 ^(Z) + l)^) stands for the symmetric part of D. By taking into account (4.22 1, we have 



2 2 " 

lim E|7/(t)|2 = lim Tr V{t) = ^Tr £>" = ^ V (ReAi)-^ 



t— >oo 



1=2 



U 



Remark 4.7. Estimate (4.201 was derived in IdTI for CPs with positive weights. A similar estimate was 
obtained in ||3T]| in the context of analysis of a neuronal network. 



5 CPs on undirected graphs 

In this section, we apply the results of the previous section to CPs on undirected graphs. The analysis reveals 
the contribution of the network topology to stability of CPs. In particular, we show that the dimension and 
the structure of the cycle subspace associated with the graph of the network are important for stability. The 
former quantity, the first Betti number of the graph, is a topological invariant of the graph of the network. 

5.1 Graph-theoretic preUminaries 

We start by reviewing certain basic algebraic constructions used in the analysis of graphs (cf. Q). Through- 
out this subsection, we assume that G = {V{G), E{G)) is a connected graph with n vertices and m edges: 

V{G) = {vi,V2,...,Vn} and E{G) = {ei,e2, . ■ ■ ,6^} . 

The vertex space, Co{G), and the edge space, Ci{G), are the finite-dimensional vector spaces of real- valued 
functions on V{G) and E{G), respectively. 

We fix an orientation on G by assigning positive and negative ends for each edge in E{G). The matrix 
of the coboundary operator H : Ci{G) — ;■ Co{G) with respect to the standard bases in Co(G) and Ci{G) 
is defined by 

1, Vj is a positive end of Cj, 



H = (hi,) G 



hij = <^ —1, Vj is a negative end of ei , 
0, otherwise. 



(5.1) 



The Laplacian of G is expressed in terms of the coboundary matrix 

L = H'^H. (5.2) 

By (5 = {V{G),E{G)) C G we denote a spanning tree of G, a connected subgraph of G such that 



V{G) 



n and 



E{G) 



n — 1. 



G contains no cycles. Without loss of generality, we assume that 

E{G) = {ei,e2,...,en-i}. 



(5.3) 
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A cycle O of length \0\ = k is a cyclic subgraph of G: 

= {V{0),E{0))CG: V{0) = {vi„v,„...,Vi,}, E{0) = {{vi„v,,),{v,„v,,) . . . ,{v,„Vi,)}, 

for some k distinct integers (ii, ^2, ■ ■ • ,ik) £ N'^- Two cyclic ordering of the vertices of O induce two 
possible orientations. Suppose the orientation of O has been fixed. We will refer to it as the cycle orientation. 
For each Cj G E{0), we thus have two orientations: one induced by the orientation of G and the other 
induced by the cycle orientation. We define i{0) = (Ci, ^2, • • • , im)^ G Ci{G) such that 

1, if Cj G £'(0) and the two orientations of e, coincide, 
— 1, if ej G E{0) and the two orientations of ei differ, (5.4) 

0, otherwise. 

To each cycle O of G, there corresponds C(0) G Ci(G). All such vectors span the cycle subspace of G, 
Cyc(G) C Ci{G). The cycle subspace coincides with the kernel of the incidence mapping H^ 

Cyc(G) = ker H'^ , (5.5) 

and its dimension is equal to the corank of G 

c = m — n + 1. (5.6) 

To each edge Cn-i+k, k & [c], not belonging to the spanning tree G, there corresponds a unique cycle 
Ojfc such that 

en-i+k e E{Ok) C E{G) U {ek}. 

We orient cycles Ok,k G [c] , in such a way that the orientations of tn-i+k as an edge of G and that of Ok 
coincide. The vectors 

e'^ = e(Ofc), A:G[c], (5.7) 

form a basis in Cyc (G). We will refer to cycles Ofe, /c G [c] as the fundamental cycles of G. 
Define ex m matrix 



z 



e' 



V-y 



By construction, Z has the following block structure, 

Z = {QIc), (5.8) 

where Ic is the c x c identity matrix. Matrix Q = (qki) G M'^^*.""^) contains the coefficients of expansions 

of Cn-i+k, k G [c] with respect to {ci, i G [n — 1]} 

n— 1 

en-i+k = - ^ qkiei, Qki G {0, ±1}. (5.9) 

1=1 

Here, el, i G [m] denote the oriented edges of G. This motivates the following definition. 
Definition 5.1. 1. Matrix Q G M'^^^"^^) is called a cycle incidence matrix ofG. 
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2. Matrix Lc{G) = QQ E W^^'^ is called a cycle Laplacian ofG. 

The following properties of the cycle Laplacian follow from its definition. 

A The spectrum of Lc{G) does not depend on the choice of orientation used in the construction of Q. 
Indeed, if Qi and Q2 are two cycle incidence matrices of G corresponding to two distinct orientations 
then Q2 = PcQiPt, where diagonal matrices 

Pt = diag{pi,p2, . . . ,Pn-i} G m("-i)x("-i) and P, = diag{p„,p„+i, . . . ,p^} G M^x^ 

If the two orientations of G yield the same orientation for edge Cj G E{G),i G [m], then pi = 1; and 
Pi = —1, otherwise. Thus, 

Q2QJ = PcQiPtPjQlPj = PcQiQjPj. 

The spectra of Q2Q2 ^^'^ QiQj coincide, because Pc is an orthogonal matrix. 



6 



(L,(G)),, = (Row,(L,(G)),Row,(Le(G))) = | Jj^jn q^.,^ • _, ^^ (5-10) 



C If the cycles are disjoint, then assuming that that Ok,k G [c] , are ordered by their sizes, we have 

Xk{Ic + QQ'^) = \Ok\,k£[c]. (5.11) 

The cycle incidence matrix provides a convenient partition of the coboundary matrix. 

Lemma 5.2. Let G = (y{G),E{G)) be a connected graph of positive corank c. Then using the notation of 
this section, the coboundary matrix 

^=(-q)^> (5.12) 

where H is the coboundary matrix of a spanning tree G, and Q is the corresponding cycle incidence matrix. 
Proof. Since ranki:^ = rank^ = n — 1, there is a unique B G M'^^^"^^) such that 

H = ( M . (5.13) 



Using (5.13 1 and (5.8 1, we obtain 

ZH = =^ QH + BH = =^ B = -Q. 

D 
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5.2 Stability analysis 



We are now in a position to apply the results of Section [4] to study CPs on undirected graphs. Let G = 
{V{G),E{G)) be a connected undirected graph. Since the interactions between the agents are symmetric, 



the coupling matrix in (4.15 1 can be rewritten in terms the coboundary matrix of G and the conductance 
matrix C = diag(ci, C2, . . . , Cm) 

D = -H'^CH. (5.14) 

The conductances Ci &M.,i ^ [m] are assigned to all edges of G. If the network is simple, G = 



Let G be a spanning tree of G. We continue to assume that the edges of G are ordered so that ( 5.3 1 holds. 
Let H, Q, and G = diag (Ci, C2), Ci G M(«-i)x(n-i)^ (j^ ^ ^cxc^ ^^ ^^^ coboundary, cycle incidence 
matrix and conductance matrices corresponding to the spanning tree G, respectively. Using (5.12 1, we recast 
the couphng matrix as 



D = -H'{Gi + Q'G2Q)H. 



(5.15) 



To form the reduced equation, we let 



S = iHH'^)--2H 



and y = Sx. 



Then 



where 



D 



y = Dy + aSw, 
-{HH'^f2{Gi + Q'^G2Q){HH^)l 



(5.16) 



(5.17) 



Both D and D are symmetric matrices. By Lemma 



2.6 



the eigenspaces of D and D are related via S. The 
EVs of D are the same as those of D except for a simple zero EV Ai = corresponding to the constant 
eigenvector e. 



A CP with positive weights q's is always convergent, as can be easily seen from (5.17 1. For a general 
case, we have the following necessary and sufficient condition for convergence of the CP on an undirected 
graph. 



Theorem 5.3. The CP {3^) with matrix { 5.14 ) is convergent if and only if matrix Gi + Q^G2Q is positive 
definite for some spanning tree G. 



Proof. By (5.17 1, Z) is a stable matrix if and only if Gi + Q^ G2Q is positive definite. 



D 



If D £ V stochastic stability of the CP (4. 15 )o and ( 5. 14 ) is guaranteed by Theorem 4.6 In particular. 



(4.20 1 characterizes the dispersion of trajectories around the consensus subspace. Theorems 3.3 and 4.6 
provide explicit formulas for the rate of convergence and the degree of stability of convergent CPs on undi- 



rected graphs. Specifically, let TV = (G, G) be a network corresponding to ( 4.15 ) with D e V (cf. ( 5.15 i). 
Let 

= Ai < A2 < • • • < A„ 



denote the EVs oi —D and define 



n 

a{M) = X2 and p(AA) = V-. 

-f^ A,; 



(5.18) 



i=2 



Formulas in (5.18 1 generalize algebraic connectivity and (up to a scaling factor) total effective resistance of 
a simple graph to weighted networks corresponding to convergent CPs on undirected graphs. By replacing 
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theEVsof Dby those of Z)'' in (5.18 1, the definitions of a (AA) and p{M) can be extended to convergent CPs 
with normal coupling matrices. For simple networks, there are many results relating algebraic connectivity 
and total effective resistance and the structure of the graph (cf. llT4l [Tl [TTl l8l l9l l50l [191 [35] ). Theorems [3.3 



and 4.6 link structural properties of the network and dynamical performance of the CPs. 



In conclusion of this section, we explore some implications of (5.17) for stability of (4. 15 1. To make the 
role of the network topology in shaping stability properties of the system more transparent, in the remainder 
of this paper, we consider simple networks, i.e., C = Im. In the context of stability of CPs, the lower bounds 
for a (A/") and the upper bounds for p{M) are important. 

Lemma 5.4. Let H stand for the coboundary matrix of a spanning tree G of undirected graph G and let Q 
be the corresponding cycle incidence matrix. Then 

A 

a{G) > a{G)Xi (/„_i + Q'^Q 

6 

p{J\l) < mm < - — — , , z } < [n — I) mm < 1, 



Ai(/n-i + Q"^Q)' a{G) J"' ' I 'a(G) 

where a{G) stands for the algebraic connectivity of G, and Ai (/n-i + Q'^Q) denotes the smallest 
EV of the positive definite matrix In-i + Q Q- 

Proof. Since AA is a simple network, the coupling matrix D taken with a negative sign is the Laplacian 
of G, L = H'^ H. Likewise, L = H'^ H is a Laplacian of G. Let 

= Ai(G)<A2(G)<---<A„(G) 

denote the EVs of L. Below we use the same notation to denote the EVs of other positive definite matrices, 
e.g., L and /„_i + Q'^^Q. 



By Lemma 2.6 the second EV of G, a{G), coincides with the smallest EV of 

L = -D = {HH'^)'2{In-i + Q'^Q)iHH'^)-2. 

Below, we will use the following observations. 

a The sets of nonzero EVs of two symmetric matrices HH^ and L = H^ H coincide. Since the former is 
a full rank matrix, the spectrum of HH'^ consists of nonzero EVs of G. In particular, 

Xi{HH^) = a{G). (5.19) 

b The EVs of L and those of {HH^){ln,-i + Q^ Q) coincide. 

Using the variational characterization of the EVs of symmetric matrices (cf. |[20ll ) and the observations a 
and b above, we have 

Ai(L) = Ai {{HH'^){In-i + Q^Q)) > Xi{HH'^)Xi{In-i + Q^Q) = a(G)Ai(/„_i + Q^Q). 

Hence, 

a{G) = Ai(L) > a(G)Ai(/„_i + Q'^Q). 
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Likewise^ 



p{G) = Tr(-i)-i)=Tr {(^FT)-i(/„_i + QTg)-i| 
Tr{(Fi^T)-i} p[G) r 



< 



Ai(/„-i + QTQ) Ai(/„_i + gTg) Ai(/„_i + QTQ)- 



(5.20) 



A symmetric argument yields 



P{G)< 



TV (/„_i + QTq)-i Tr (J„_i + QTq)-i 



\i{HH^) 



a{G) 



D 



Lemma 



5.4 



shows respective contributions of the spectral properties of the spanning tree G and those 
of the cycle subspace to the algebraic connectivity and effective resistance of G. In this respect, it is of 
interest to study the spectral properties of /„_i + Q^Q, in particular, its smallest EV and the trace. Another 
motivation for studying /„_i + Q'^Q comes from the following lemma. 



Lemma 5.5. Under assumptions of Lemma 5.4 solutions ofCP {4.15) satisfy 



limE|fl'x(t)p = — 



t— >oo 



k{G,G), K(G,G) = Tr(/„_i + Q"^Q)-i. 



Proof. The reduced equation for y = Hx has the following form 

y = Dy + aHw, 

where 

D = HDH+. 



Using D = —H'^H and (5.12i, we rewrite (5.23 1 as follows 

D = HDH+ = -HH'^HH'^{HH'^)-^ = -HH'^{In-i + Q^Q). 



By applying the argument used in the proof of Theorem |4. 6 1 to the reduced equation ( 5.22| ), we obtain 



lim E|Fx(t)p 



^-Tr{HH^{D)-^} = ^->,{G,G). 



(5.21) 

(5.22) 
(5.23) 

(5.24) 
1 

(5.25) 



The combination of (5.25 1 and (5.23 1 yields (5.21 1. 
D 

The following lemma provides the graph-theoretic interpretation of k(G, G). 

Lemma 5.6. Let G = (y(G), E{G)), \V{G)\ = n, be a connected graph and G <Z G be a spanning tree 
ofG. 



A If G is a tree then 



k{G,G) = n-l. 



(5.26) 



'Estimate i5.20' uses the following inequality: Xi(A)Ti B < Tr (AB) < A„(yl)Tr_B, which holds for any symmetric 
A G R"^" and nonnegative definite B £ M"^" (cf. 1221 ). If A = A is diagonal, the double inequality above is obvious. The case 
of symmetric A — UMJ~^ is reduced to the previous one via the following identity Tr {UhU~^ B} = Tr {AU^ BU} . 
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B Otherwise, denote the corank of G by c > and let {Ok}%^i be the system of fundamental cycles 
corresponding to G. 



B.l Denote 



Then 



IJ'= - 
n 

k=l 



^^(|0,|-1). (5.27) 



1 k(G,G) 

< / < 1, (5.28) 



1 + /i n — 1 



B.2 IfO < c<n-l then 



where 



l-^(l-i)<^<l. (5.29, 

n — 1 \ J n — 1 

5 = max{\Ok\ + y2\OknOi\}. (5.30) 



"^['^^ i^k 



B.3 IfOk,k£ [c] are disjoint. Then 

k{G,G) 



In particular, 



n — 1 n - , 

\ fc=i 



k(G,G)^^_^/ 1 



n-1 n- 1 V minfcg[c] |Ofc| 



n-1 n - 1 y Efce[c] l^fcl y n-1 \ maxfcg^c] |Ofc| 

Proo/ 
A If G is a tree then Q = and k{G, G) = Tr /„_i = n - 1. 
B.l Suppose c > 0. Let Aj, i G [n], denote the EVs of /„_i + Q^Q: 

1 < Ai < A2 < • • • < A„_i 
By the arithmetic -harmonic means inequahty, we have 

f ^- y h] <^-y^< — ^ — ^ < 1. (5.32) 



The double inequality in (5.28 1 follows from (5.32i by noting that 

n-1 



<G,G) = Y^^ 



j=i 



and 

n-1 



J]; A, = Tr (/„_i + Q^Q) = n - 1 + Tr QQ^ = n - 1 + J]] (|Ofc| - 1) . 

i=l fc=l 
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B.2 Since rank Q^Q = c < n — 1, by the interlacing theorem (cf. Theorem 4.3.4 |[20l ). we have 

1 < Afc(/„_i + Q^Q) < \k+c{In-i) = 1, /c E [n - 1 - c]. 
For /c > n — 1 — c, we use the Weyl's Theorem to obtain 

1 < Afc(/„_i + Q^Q) < 1 + A„_i(QTQ) = 1 + \c{QQ^). 
Using ( 5.10| ), by the Gershgorin's Theorem, we further have 



1 + \c{QQ^) < max{|Ofc| + V |Ofc n Oi\}. 



The combination of ( 5.34 1 and ( 5.35| ) yields 



n— 1 ^ 



k=i 



(5.33) 



(5.34) 



(5.35) 



B.3 Since each cycle Ok contains at least two edges from the spanning tree G, then the number of disjoint 
cycles c can not exceed the integer part of 0.5(n — 1). In particular, c < n — 1. 



By (5.101, 



QQ'^ = diag(|Oi| - 1, IO2I - 1, ... , \Oc\ - 1), 
because the cycles are disjoint. Further, the nonzero eigenvalues of Q'^Q and QQ'^ coincide. Thus, 



T^\-l 



Afc (/„-! + Q'Q) 



10, 



1-1 

fc+C+l — 7l| 1 



k £ [n — 1 — c], 
n — c<k<n — 1, 



(5.36) 



By plugging (536 1 in (5.21 1, we obtain (5.31 1 



D 

Remark 5.7. Estimates of k{G, G) in Lemma 

how stochastic stability of CPs depends on the geometric properties of the cycle subspace associate with the 



5.6 



combined with the estimates in Lemmas 



5.4 



and 



5.5 



show 



graph, such as the first Betti number (cf. (5.29l) and the length and the mutual position the fundamental 
cycles (cf. (5.27 1, (5.28 1, (5.30l, ( 5.31| )). In particular, from (5.21) and the estimates in Lemma 5.6 



one 



can see how the changes of the graph of the network, which do not affect a spanning tree, impact stochastic 



stability of the CP. Likewise, by combining the statements in Lemma 5.6 with the following estimate of the 



total effective resistance (cf. Lemma 5.4) 



p(AA) <a{G)K{G,G), 



(5.37) 



one can see how the properties of the spanning tree and the corresponding fundamental cycles contribute to 
the stochastic stability of the CP. 
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Figure 1: Examples of graphs used in the text: (a) a path, (b) a complete graph (see Example 6.1 for 
discussion of the properties of graphs in (a) and (b)), and (c) a star. 



6 Network connectivity and performance of CPs 

In the previous section, we derived several quantitative estimates characterizing convergence and stochastic 
stability of CPs. In this section, we discuss two examples illustrating how different structural features of 
the graph shape the dynamical properties of CPs. In the first pair of examples, we consider graphs of 
extreme degrees: 2 vs. n. In the second example, we take two networks of equal degree but with disparate 
connectivity patterns: random vs. symmetric. These examples show that both the degree of the network and 
its connectivity are important. 

Example 6.1. Consider two simple networks supported by a path, Pn, and by a complete graph, Kn (Fig. [7] 
a and b). The coupling matrices of the corresponding CPs are given by 
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(6.1) 



The nonzero EVs of P„ and Kn are given by 

Ai+i(Pn) = 4sin^ ( -- ) and Ai+i(K„) = n, i = 1, 2, . . . ,n - 1. 



2n 



Thus, 



a(P„) = 4sin2(-^), a{K„ 



vr 



n, and p{Kn) = 1 — n . 



(6.2) 



(6.3) 



To compute compute p{Pn), we use the formula for the total effective resistance of a tree (cf. (5), {VT\) 



p{Pn) 



n 



n— 1 ^ 



(6.4) 



i=l 



Equation (6.3 1 shows that for re » 1, the convergence rate of the CP based on the complete graph is much 
larger than that based on the path: 



a{Kn) = n > 0(re" 



a(P„. 



(6.5) 



One may be inclined to attribute the disparity in the convergence rates to the fact that the degrees of the 
underlying graphs (and, therefore, the total number of edges) differ substantially. To see to what extent the 
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difference of the total number of the edges or, in electrical terms, the amount of wire used in the corre- 
sponding electrical circuits, can account for the mismatch in the rates of convergence, we scale the coupling 
matrices in Example |6.1| by the degrees of the corresponding graphs: 

Dri = -Dr, and D,. = Dr- 

The algebraic connectivities of the rescaled networks are still far apart: 

A2(5e) = 1 + 0{n-^) > 0(n-'') = \2{Dp). (6.6) 

This shows that the different values of a in ( |6.5| ) reflect the distinct patterns of connectivity of these networks. 

Remark 6.2. Explicit formulas for the EVs of the graph Laplacian similar to those that we used for the 
complete graph and the path are available for a few other canonical coupling architectures such as a cycle, 
a star, an rn— dimensional lattice (see, e.g., §4.4 [.14.1 ). Explicit examples of graphs with known EVs can 
be used for developing intuition for how the structural properties of the graphs translate to the dynamical 
properties of the corresponding CPs. 

Equation ( |6.5| ) shows that the rate of convergence of CPs based on local nearest-neighbor interactions 
decreases rapidly when the network size grows. Therefore, this network architecture is very inefficient for 
coordination of large groups of agents. The following estimate shows that very slow convergence of the CPs 
based on a path forn » 1 is not specific to this particular network topology, but is typical for networks with 
regular connectivity. For graph Gn of degree d on n vertices, the following inequality holds O 



a{Gn) < 2d 



21og2n 
diam(G„) 



This means that if the diameter of G„ grows faster than log2 n (as in the case of a path or any lattice), the 
algebraic connectivity and, therefore, the convergence rate of the CP goes to zero as n — > oo. Therefore, 
regular network topologies such as lattices result in poor performance of CPs. In contrast, below we show 
that a random network with high probability has a much better (in fact, nearly optimal) rate of convergence. 
The algebraic connectivity of the (rescaled) complete graph does not decrease as the size of the graph 
goes to infinity (cf. (6.6 1). There is another canonical network architecture, a star (see Fig. [ij;), whose 



algebraic connectivity remains unaffected by increasing the size of the network: 

However, both the complete graph and the star have disadvantages from the CP design viewpoint. CPs based 
on the complete graph are expensive, because they require O(n^) interconnections. The star uses only n — 1 
edges, but the performance of the entire network critically depends on a single node, a hub, that connects to 
all other nodes. In addition, update of the information state of the hub requires simultaneous knowledge of 
the states of all other agents in the network. Therefore, neither the complete graph nor the star can be used 
for distributed consensus algorithms. 

Ideally, one would like to have a family of sparse graphs that behaves like that of complete graphs in the 
sense that the algebraic connectivity remains bounded from zero uniformly: 

aiGn) >a>0, n G N. 

Moreover, the greater the value of a the better the convergence of the corresponding CPs. Such graphs 
are called (spectral) expanders |fT9ll43l . Expanders can be used for producing CPs with a guaranteed rate 
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Figure 2: Schematic representation of the local connections in graphs used in Example |6.5[ (a) a cycle of 
degree 4 and (b) a bipartite graph of degree 4 with random connections. 

of convergence regardless of the size of the network. There are several known explicit constructions of 
expanders including celebrated Ramanujan graphs E7ll25l (see |fT9l for an excellent review of the theory and 
applications of expanders). In addition, random graphs are very good expanders. To explain this important 
property of random graphs, let us consider a family of graphs {G„} on n vertices of fixed degree (i > 3, i.e., 
Gri is an (n, d)— graph. The following theorem due to Alon and Boppana yields an (asymptotic in n) upper 
bound on a(G„). 

Theorem 6.3. / [55l/ For any (n, d)— graph Gn, d > 3 and n ^ 1, 

a{Gn) < g{d) + o„(l), g{d) := d - 2Vd^^ > 0. (6.7) 

Therefore, for large n, a(G„) can not exceed g{d) more than by a small margin. The following theorem 
of Friedman shows that for a random (n, (i)-graph G„, a(G„) is nearly optimal with high probability. 

Theorem 6.4. MSV For every e > 0, 

Prob {a{Gn) > g{d) - e} = 1 - o„(l), (6.8) 

where {Gn} is a family of random (n, d)- graphs. 

Theorem |6.4| implies that CPs based on random graphs exhibit fast convergence even when the number 
of dynamic agents grows unboundedly. Note that for n » 1, an (n, (i)-graph is sparse. Nonetheless, the CP 
based on a random (n, d) -graph possesses the convergence speed that is practically as good as that of the 



normalized complete graph (cf. (6.6 1). Therefore, random graphs provide a simple practical way of design 



of CPs that are efficient for coordinating large networks. 

Example 6.5. In this example, we compare performance of two CPs with regular and random connectivity. 

(a) The former is a cycle on n vertices, Gn. Each vertex ofGn is connected to d/2 (d is even) of its nearest 

neighbors from each side (see Fig. ^jp). 

(b) The latter is a bipartite graph on 2m vertices, -B2m- The edges are generated using the following 

algorithm: 

1. Let p : [m] — )• [m] be a random permutation. In our numerical experiments, we used MATLAB 
function randperm to generate random permutations. For i G [m], add edge (i, m + p{i)). 

2. Repeat step 1. d — 1 times. 
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Figure 3: Numerical simulations of the CPs based on degree 4 graphs with regular and random connectivity 
(see Example 6.5 for the definitions of the graphs). Plots (a) and (b) show convergence of CPs for two 
networks. For each network architecture three network sizes were used 100 (shown in dashed line), 200 
(dash-dotted line), and 400 (solid line). The graphs show the Euclidean norm of the trajectory of the reduced 
system y. The CP based on random graph in (b) shows much better convergence rate compared to that based 
on a regular graph in (a). Plots in (c) and (d) show the corresponding results for randomly perturbed CPs. 
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In Fig. |3] we present numerical simulations for CPs based on graplis in Example |6.5| for d = 4 and 
n S {100, 200, 400}. The rates of convergence for these CPs are summarized in the following table. 



Table 5.4 



a\n 


100 


200 


400 


oo 


a{Cn) 
a{Bn) 


.020 
.597 


.005 

.554 


.001 

.547 



4 - 2^3 « 0.536 



The CP based on regular graphs C„ has a very small rate of convergence already for n = 100. As n — ;■ oo 
a{Cn) tends to zero. In contrast, random graphs yield rates of convergence with very mild dependence on 
the size of the network. For the values of n used in this experiment, a{Bn) (n = {1, 2, 4} x 10^) are close 
to the optimal limiting rate a{Boo) = 4 — 2-v/3 ^ 0.536. The difference of the convergence rates is clearly 
seen in the numerical simulations of the corresponding CPs (see Fig.|3]a,b). The trajectories generated by 
CPs with random connections converge to the consensus subspace faster. We also conducted numerical 



experiments with randomly perturbed equation ( 4. 1 1 to compare the robustness to noise of the random and 
regular CPs. The CP on the random graph is more stable to random perturbations than the one on the regular 
graph (see Fig.|3};,d). 



7 Conclusions 



In this paper, we presented a unified approach to studying convergence and stochastic stability of a large 
class of CPs including CPs on weighted directed graphs; CPs with both positive and negative conductances, 
time-dependent CPs, and those under stochastic forcing. We derived analytical estimates characterizing 
convergence of CPs and their stability to random perturbations. Our analysis shows how spectral and struc- 
tural properties of the graph of the network contribute to stability of the corresponding CP. In particular, it 
suggests that the geometry of the cycle subspace associated with the graph of the CP plays an important role 
in shaping its stability. Further, we highlighted the advantages of using expanders and, in particular, random 
graphs, for CP design. 

The results of this paper elucidate the link between the structural properties of the graphs and dynamical 
performance of CPs. The theory of CPs is closely related to the theory of synchronization I6l l28ll39l !44l. 
With minimal modifications, the results of the present study carry over to a variety coupled one-dimensional 
dynamical systems ranging from the models of power networks ||T2|| to neuronal networks ||3T1 |32l |33l and 
drift-diffusion models of decision making fW]. Moreover, the method of this paper naturally fits in into a 
general scheme of analysis of synchronization in coupled systems of multidimensional nonlinear oscillators. 
An interested reader is referred to 1 29 , 30 , 32 , 33 1 for related techniques and applications. 

Acknowledgements. The author thanks Dmitry Kaliuzhnyi-Verbovetskyi for useful discussions and the 
referees for careful reading of the manuscript and many useful suggestions. Anatolii Grinshpan provided 



comments on an earlier version of this paper, including a more concise proof of Lemma 2.6 Part of this 
work was done during sabbatical leave at Program of Applied and Computational Mathematics of Princeton 
University. This work was supported in part by the NSF Award DMS 1 109367. 



References 



[1] N. Alon, Eigenvalues and expanders, Combinatorica, 6(2), 83-96, 1986. 



26 



[2] N. Alon, V.D. Milman, il isoperimetric inequalities for graphs, and superconcentrators, /. Combin. 
Theory Ser. B, 1985. 

[3] V.I. Arnold, Ordinary Differential Equations, Springer- Verlag, 1992. 

[4] M. Balerini et al. Interaction ruling animal collective behavior depends on topological rather than 
metric distance: Evidence from a field study, PNAS, 105(4), 1232-1237, 2008. 

[5] N. Biggs, Algebraic Graph Theory, second ed., Cambridge University Press, 1993. 

[6] I.I. Blekhman, Synchronization in Science and Technology, AMSE Press, New York, 1988. 

[7] Bela BoUobas, Modern graph theory. Graduate Texts in Mathematics, vol. 184, Springer, New York, 
1998. 

[8] F.R.K. Chung, Spectral Graph Theory, CBMS Regional Conference Series in Mathematics, No. 92, 
1997. 

[9] S. Cioaba, Eigenvalues and edge-connectivity of regular graphs. Linear Algebra and its Applications, 
vol. 432 (1), 458-470, 2010. 

[10] J. Cortes and F. BuUo Coordination and geometric optimization via distributed dynamical systems, 
S JAM Journal on Control and Optimization, 44 (5), 1543-1574, 2005. 

[11] B.P. Demidovich, Lectures on mathematical theory of stability, Nauka, Moscow, 1967. (in Russian) 

[12] F. Dorfler and F. BuUo, Synchronization and Transient Stability in Power Networks and Non-Uniform 
Kuramoto Oscillators, submitted. 

[13] J. Friedman, A Proof of Alon 's Second Eigenvalue Conjecture and Related Problems, Memoirs of the 
American Mathematical Society, vol. 195, 2008. 

[14] M. Fiedler, Algebraic connectivity of graphs. Czech. Math. J. 23(98), 1973. 

[15] J. Jost, Dynamical networks, in J. Feng, J. Jost, and M. Qian, (Eds.) Networks: From Biology to Theory, 
Springer, 2007 

[16] F.R. Gantmacher, Matrix Theory, vol. 1, reprinted by the AMS, 2000. 

[17] A. Ghosh, S. Boyd, and A. Saberi, Minimizing effective resistance of a graph, SIAM Rev., 50(1), 
37-66, 2008. 

[18] J. Hale, Ordinary Differential Equations, Krieger, 2nd edition, 1980. 

[19] S. Hoory, N. Linial, and A. Wigderson, Expander graphs and their applications, Bulletin of the Ameri- 
can Mathematical Society, vol. 43, no. 4, pp 439561, 2006. 

[20] R.A. Horn and C.R. Johnson, Matrix Analysis, Cambridge University Press, 1999. 

[21] I. Karatzas and S.E. Shreve, Brownian Motion and Stochastic Calculus, 2nd ed.. Springer, New York, 
1991. 



27 



[22] D. L. Kleinman and M. Athans, The design of suboptimal linear time-varying systems, IEEE Transac- 
tions on Automatic Control, 13, 150-159, 1968. 

[23] T. Li and J. F. Zhang, Mean square average consensus under measurement noises and fixed topologies: 
Necessary and sufficient conditions, Automatica, vol. 45, no. 8, pp. 1929-1936, 2009. 

[24] P. Lin, Y. Jia, and L. Li, Distributed robust H^o consensus control in directed networks of agents with 
time-delay. Systems & Control Lett., 57, 643-653, 2008. 

[25] A. Lubotzky, R. Phillips, and P. Sarnak, Ramanujan graphs, Combinatorica, 8, 161-278, 1988. 

[26] I.G. Malkin, The theory of stability of motion, second edition. Editorial, Moscow, 2004 (in Russian). 

[27] G. Margulis, Explicit group-theoretic constructions of combinatorial schemes and their applications in 
the construction of expanders and concentrators. (Russian) Problemy Peredachi Informatsii 24 (1988), 
no. 1, 51-60; (English translation in Problems Inform. Transmission 24 (1988), no. 1, 39-46). 

[28] E. Mosekilde, Yu. Maistrenko, D. Postnov, Chaotic Synchronization: Applications to Living Systems, 
World Scientific Publishing, London, 2002. 

[29] G.S. Medvedev, Synchronization of coupled hmit cycles, /. Nonlin. ScL, 21(3), 441-464, 2011. 

[30] G.S. Medvedev, Synchronization of coupled stochastic limit cycle oscillators. Physics Letters A (374), 
1712-1720, 2010. 

[31] G.S. Medvedev, Electrical coupling promotes fidelity of responses in the networks of model neurons. 
Neural Computation, 21 (11), 3057-3078, 2009. 

[32] G.S. Medvedev and S. Zhuravytska, The geometry of spontaneous spiking in neuronal networks, J. 
Nonlinear Sci., DOT: 10.1007/s00332-012-9125-6, 2012. 

[33] G.S. Medvedev and S. Zhuravytska, Shaping bursting by electrical coupling and noise, Biol. Cybern., 
106 (2), 67-88, 2012. 

[34] L. Moreau, Stability of continuous-time distributed consensus algorithms, 43rd IEEE Conference on 
Decision and Control, 2004. 

[35] A. Nilh, On the second eigenvalue of a graph. Discrete Math., 91(2): 207-210, 1991. 

[36] R. Olfati-Saber, Evolutionary Dynamics of Behavior in Social Networks, Proc. of the 46th IEEE Con- 
ference on Decision and Control, 2007. 

[37] R. Olfati-Saber, J.A. Fax, and R.M. Murray, Consensus and Cooperation in Networked Multi-Agent 
Systems, Proceedings of the IEEE, vol. 95, no. 1, pp. 215-233, Jan. 2007. 

[38] R. Olfati-Saber and R.M. Murray, Consensus problems in networks of agents with switching topology 
and time-delays, IEEE Trans, on Automatic Control, 49(9), 1520-1533, 2004. 

[39] A. Pikovsky, M. Rosenblum, J. Kurths, Synchronization: A Universal Concept in Nonlinear sciences, 
University Press, Cambridge, 2001. 



28 



[40] I. Poulakakis, L. Scardovi, and N. Leonard, Coupled stochastic differential equations and collective de- 
cision making in the alternative forced choice task, Proceedings of the American Control Conference, 
2010. 

[41] W. Ren and R. W. Beard, Consensus seeking in multi-agent systems under dynamically changing 
interaction topologies, IEEE Transactions on Automatic Control, Vol. 50, No. 5, pp. 655-661, 2005. 

[42] W. Ren, R.W. Beard, and E.M. Atkins, Information consensus in multivehicle cooperative control, 
IEEE Control Systems Magazine, April 2007, 71-82. 

[43] R Sarnak, What is an expander?. Notices of the American Mathematical Society 51, 762-763, 2004. 

[44] S.H. Strogatz, Sync: The emerging science of spontaneous order, Hyperion, 2003. 

[45] D. Sumpter et al. Consensus decision making by fish, Curr. Bio., 18(22), 1713-1111, 2008. 

[46] J. Sun, S. Boyd, L. Xiao, and R Diaconis, The fastest mixing Markov process on a graph and connec- 
tion to a maximum variance unfolding problem, SIAM Rev., 48(4), 681-699. 

[47] J. Wang and N. Elia, Mean square stability of consensus over fading networks with nonhomogeneous 
communication delays. Proceedings of the 47th IEEE Conference on Decision and Control, 2008. 

[48] L. Xiao and S. Boyd, Fast linear iterations for distributed averaging. Systems & Control Letters, 53, 
65-78, 2004. 

[49] L. Xiao, S. Boyd, and S.-J. Kim, Distributed average consensus with least-mean-square deviation, J. 
Parallel Distrib. Comput., 67, 33-46, 2007. 

[50] W. Xiao and I. Gutman, Resistance distance and Laplacian spectrum, Theor. Chem. Ace, 110 : 284- 
289, 2003. 

[51] G.F. Young, L. Scardovi, and N.E. Leonard, Robustness analysis of consensus protocols. Proceedings 
of the American Control Conference, 2010. 



29 



